NSF PAR Search | NSF Public Access Repository

Note: When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).
What is a DOI Number?

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Vision-language model-driven scene understanding and robotic object manipulation

https://doi.org/10.1109/CASE59546.2024.10711845

Liu, Sichao; Zhang, Jianjing; Gao, Robert X; Vincent_Wang, Xi; Wang, Lihui (August 2024, IEEE)

Full Text Available
Vision AI-based human-robot collaborative assembly driven by autonomous robots

https://doi.org/10.1016/j.cirp.2024.03.004

Liu, Sichao; Zhang, Jianjing; Wang, Lihui; Gao, Robert X (July 2024, CIRP Annals)

Autonomous robots that understand human instructions can significantly enhance the efficiency in human-robot assembly operations where robotic support is needed to handle unknown objects and/or provide on-demand assistance. This paper introduces a vision AI-based method for human-robot collaborative (HRC) assembly, enabled by a large language model (LLM). Upon 3D object reconstruction and pose establishment through neural object field modelling, a visual servoing-based mobile robotic system performs object manipulation and navigation guidance to a mobile robot. The LLM model provides text-based logic reasoning and high-level control command generation for natural human-robot interactions. The effectiveness of the presented method is experimentally demonstrated.
more » « less
Full Text Available
Efficient data management for intelligent manufacturing

https://doi.org/10.1016/B978-0-443-13924-6.00010-7

Zhang, Jianjing; Liu, Sichao; Wang, Lihui; Gao, Robert (January 2024, Elsevier)

Full Text Available
Integrating Large Language Model for Natural Language-Based Instruction toward Robust Human-Robot Collaboration

https://doi.org/10.1016/j.procir.2024.10.093

Gao, Fanru; Xia, Liqiao; Zhang, Jianjing; Liu, Sichao; Wang, Lihui; Gao, Robert X (January 2024, Procedia CIRP)

Full Text Available
Neural rendering-enabled 3D modeling for rapid digitization of in-service products

https://doi.org/10.1016/j.cirp.2023.04.013

Zhang, Jianjing; Liu, Sichao; Gao, Robert X.; Wang, Lihui (January 2023, CIRP Annals)

Full Text Available

Search for: All records